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and instructional method is proposed as one way to avoid some of the: 


‘problems of cther approaches, including examining interactions 
tetween cognitive processes and instructional method. Finally, it is 
suggested that ATI researchers precede formal investigations by an 
obserwational phase: instead of beginning research by generating a. 
prediction as to what students are likely to do in instructional 


situations offering a variety of alternatives, primary observation of 


the students’ selection of options is preferable., (Author/RL) 
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This paper discusses some of the problems in research on aptitude 
treatment interactions (ATIs). “Among these is the Inconsistency and 4 
lack of general ity to many ATI findings, especially: in classroom 
based ATI investigations. It is suggested that such investigations 
may wel] be of limited generality due to the nature of ‘the phenomena. 
The importarice of careful calssification of aptitude and treatnent/ 
variables is also discussed. «It is suggested that investigating the 
interactipn betwen individual differences in prior sehievanant and 
instrukt{pnal method avoids some of the problems of other approaches, 
including’ examining interactions between cognitive processes and 
instructional method. Finally, some suggestions are made that ATI 
researchers might precede more formal investigations by an observational 


phase. : ( 
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‘Adapting thatroctlor te Individual “differences among students is an 
Qld challenge to education. As has been suggested elsewhere (Tobias, 1976) 
| perhaps the first record of instruction being cited te individual. 
diff@rences among students was Plato's recording of Socrates' attempt to 
instruct the stave boy Meno.in the mysteries of rectangles. | might note f 
parenthetically that old Socrates knew ats beans since his instruction was 
adapted sinely te the kid's prior achievement in this particular area, a 
theme that will returned to. ig a 
. Since then there have been many exhortations to teachers to individ- 
ualize Instruction. One can go back to Thorndike in 1911 for-the first of 
these calls (Thorndike, 1911) and more recently there have’ been numerous 
_ others. It Is only fair to note eee such’ exhortations have been as 


effective as inveighing against the weather. There is a good deal of 


individualization of the rate of-instruction rampant Tn the land. Keller's 
(1968) people are personalizing Instruction, Block's (1971) and Bloom's 4 
followers have been getting their students to master Instruction, and 

various computer managed. instructional sequences are looping students to 


- 


and fro. It should be nated, however, that in these instructional schemes 


students proceed through essentially the same instructional material in . 
essentially the same way. The fast ones can skip out of a lesson pretty 


easily, the slower ones chug along at a more leisurely rate by ‘virtue of 


being looped back until the elusive mastery has been attained. 
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- There are some large scale attempts to adapt the method of instruction 
‘to Individual. differences sees students. Perhaps the largest of these is the 
advanced Instructional system of the U.S. Air Force which has been 
docimanted by the McDonald group (Notes 1,2). Nevertheless, these are in 
‘the minority and, fn general, what adaptations of the method of fnstructton 
exist are based on the teacher's, or the bueecunt tonal designer's art 
rather than on persuasive theory or research Findings. 

This discussion has, so far, been: limited to the applied consequences 
of adapting instruction to Individual differences. | believe that such 
adaptation aise poses a formidable challenge to basic researchers and to our 7 
understanding of the phenomena which have traditionally been of central 
concern to educational psychologists: tie nature of Individual difference 
and determining what practices in various instructional methods can actually 
lead to dietacsavad In student achievement. The: clarifycation of: this 252 
problem could well stand as one of the major definitions of what the discipline 
of ee psychology is, or should be all about. Frank Farley's whimsical 

“subtitle! for this sympos{um: "The State of the Union" is perfagtly appropriate. 
Adapting instruction to student differences is at the center of ‘this union 
and the solution of this problem, would be a major accomplishment for educational 
researchers and educational psychologists. 

Failure to solve this problem Is caused principal ly by the reluctance of .- 


ATI's to be consistant, replicable, or robust. As everyone knows ATI stands 


for aptitude treatment interaction, and is generally defined as the interaction 


“=~ between student aptitude and different Instructional methods. As fewer 


researchers seem to know, ATI also stands for attribute ranGecne inter- 
actions, (Tobias, 1973a), or achievement treatment Ingeractions (Tobias, : 
1976; Note 3). ‘But, more about that’ later. 4 . * 

Reviews of ATI research are about as plentiful as replicated ATIs are 
_ rare. Their plentitude ts probably: caused’ by ‘the fact that ATI studies 
are hard to run, difficult to analyze, and often impossible to understand. 
Reviewers, then, bravely shoulder the burden of Informing the’ ignorant 
masses seouk the state of our arcane pursuit with prose that has all the 
lightness of a Mack truck, ‘the grace of a footbal'l | ineman trying out for 
the ballet, and the comprehens{btlity of any nine out of ten statistical - 
textbooks. To be serious for a moment, this is a difficult area to study, 
Menanding comp lex methodology and ataEree ical analyses which are just not 
easy ,to understand. Couple that with the eagerness of some investigators 
to confuse the Issue even further so that Journal reviewers wil] be 
Impressed by the difficulties of the research and, hence, ‘not judge Use 
fal lures \too severely and you will understand why some ATI research reports 
are not ae understandable. °. - lg 

\f soy Yo wants to. _have some “Light: bed-time reading they might try 

Cronbach and $now's (1977) tome suraaciaies the problems in ATI land. This 
mi lestorie in the fleld gives a detailed chronicling of the difficulties tn 


the design, analysts, and interpretation of this body of research. 


Space does not permit a.comprehens ive recounting of the genuinely 
difficult problems. of AT research. Lee Cronbach and Dick Snow made a 
major contribution to the field by chronicling most of the available, 
ATI literature and attempting to make some order out of it. Other 
reviews of this research are dies avatlabia (Snow, 1976, 1977, Tobias 


1976, 1977a). Let me try to summarize some of the major difficulties 


tn this field as detailed In these various sources. 


"Inconsistency of findings eo 


‘In many of the studles reviewed the number of significant ATIs band to 
be Balaricad by an cial equal number of nparsi gn tr leans results. Even more 
troubling Is the difficulty In determining specitteatty what attributes of 
the students, or exactly what characteristics of the instructional method : . 
accounted for the significant or nonsignificant findings. Failure to 
specify such characteristics halen it difficult to follow up leads or to 
aebaten more consistent findings. Another aspect of the inconsistencies 
noted in previous research is the fact that of those studies reporting 
significant ATIls few have been succesfully repeated. This lack of replication 
can be attributed to many variables. Many investigations are ''one shot'' 


affairs such as dissertations, or studies in which evaluators compared two 


- 
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instructional methods, and happened to: have some Individual difference 
data kicking around by which they hope to elevate a cursory avaliax toasts ad 
a sclaatt#le contribution: Such haphazard pedeunek Is unlikely to generate 
a consistent. body of findings. More disturbing Ts the fact that when 
replicattons of research attempted im use slightly different student 
samples, the eavotts were frequently different from those of the initial 
Investigation. I! will return to this theme below, but you can see the faa 


kinds of difficulties this poses for ATI research. 


Lack of generality + | 


Let me give you some examples that are hair raising to ATI researchers. 
| developed an instructional program dealing with the diagnosis of heart 
iiseste-(Sebtaks 1968) which was sybsequently used at a number of research. 
Sattar: The program was developed in a linear programmed instruction 
format, and was subsequently modified for presentation via computer seal eead 
instruction. The history and variations to this program are discussed else- 
where (Tobias, Note 4), In the Seiciatead Instruction version a ater of 
significant interactions between instructional strategies and student 
differences in prior achievement were reported. When the program was 
converted verbatim for presentation via computer assisted Instruction the 
findings obtained with ite programmed material could not be replicated. 

Fol lowing a task analysis of the CAl version of the materials, they were 
revised. In the revised Jaréten the previous findings were both replicated 


and extended (Tobias, 1973, a, b, Tobias and Duchastel, 1974). 


‘ 
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Therp are examples of other troubling Inconsistencies in ATI research. In 


her dissprtatiqn study Peterson (1977) studied the interaction between instruc- 


a 
tional /fnethod nd a number of personality variables using a night grade student 


| 


samp lq In a jsucceeding study, Peterson (1979). repeated essentially the same 


study) using a/different subject matter and a different student population. Some 


of che interactions tn the second study were opposite from those of the 

fi be, some ear similar, and some were unreplicated. Even more unsettling 
were Interactions which appeared when a multiple choice test. was the 
dependent variable and disappeared when the criterion was switched to an 
_pssay- You will grant that this is limited generality with a vengeance. 

The problem of lack of generality may not be as discouraging a phenomenon 
as It first appears. Brophy (1979) comments wath Scie lack of generality 
in recent research relating teacher behavior to student learning. The 
renascence in that area, reflected in the work of such writers as Rosenshine 
(1979), Berliner (1979), McDonald (1976), and Broohy (1979) among others has 
documentea a number of highly context specific relationships. For example, 
in the primary grades there appears to be no significant correlation, or 
significant negative correlations between learning gains and amount of 
student talk (Stalling and Kaskowitz, Note 5; Brophy and dvattana, Note 6). 
At the junior high school level, however, Evertson and her colleagues 
(Note 7) did find correlations between student talk, Sond related variables, 
and’ learning gains in seventh and eighth grade math classes. In the 
latter: study it should be noted, only some kinds-of student talk correlated 
with these gains, not amount: of student talk in general. 

‘In view of the specificity of effects seen in research felatiag 
teacher behavior to student learning, the lack of seiearhs: of ATI studies 
in classroom contexts is not surprising. The specific interaction of 
studies such as Peterson's and similar. investigations (Corno, 1979; pereeue: 
Note 8) are beginning to document similarly specific Interactions of 
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Individual difference variables In classroom contexts. It appears possible 
that in such classroom based investigations interactions should be sought 
not only among student Individual difference variables and instructional 
methods, but also interactions with the Instructional context. Specifically, | 
Interactions may well exist hateesk classroom context variables and 
Instructional methods, as suggested by Brophy's (1979) review of this research 
but higher order Interactions among context variables, instructional methods 
and student individual differences may well be the expected outcome of such 
classroom based AT! Investigations. 

The results of ATI classroom based studies may, then, be developing 
sets of findings which ate also replicable only within a specific context 
but do not generalize to other settings. This may make research in this 
area much less .fun, - well as making incredible cognitive demands upon 
readers of such research. The tables of results of these ATI studies 
(Peterson, 1977, 1979; Corno, 1979) are difficult to master at one sitting, 
two sittings, or for that matter, master in any other manner. | 
suspect that the neste of these studies are easily retrievable from the 
long term memories of only the Investigators themselves, and perhaps their 
dissertation advisors who, probably labored long and hard analyzing and re- 
analyzing the data, and then longer and harder trying to interpret the out- 


put of such electronic largesse. This may account for the curious phenomenon 


“wd 


that researchers in this particular ATI specialty have an jnteresting 
preference for citing one another's work again, and atecant uae again 
Maite it remains essentially uncited by_ strangers £5 this particular milleau. 
Perhaps they are the only ones who can comprehend, and more importantly 
easily recut the results of these studies. | have come.to envy computer 
programmers who write flexible multiple linear bacreesion programs capable of 


disgorging voluminous double, triple, quadruple, and quintuple interactions 


without having the inconvenience of having to understand them. 
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Consideration similar to these prabably promted Cronbach (1975) 

to suggest that interactions in this domain may well not have the generality * 

we initially assumed. Cronbach speculated that generalizations made’ from 

such research may well be Timited to the particular locale fn which they 

were studied, and also to the sareteuiar period in which they were found. 

He suggests that in the social sciences in general, and in ATI research in 

particular, findings may well shift from decade to decade’ rather than holding 


from time immemorial, or at least from one AERA meeting to another. 


Needs for Classification and Theory 


The inconsistency of results and the lack of generality of many ATI * 
findings points to an important problem: the need for a classification 
scheme of instructional methods on the one hand and student characteristics 
on the other. 

Our descriptive schemes for instructional methods are vague, excessively 
general, and highly descriptive. For example, homogeneous -heterogeneous 
grouping is one of the most studied problems in education, note that | did 
not say best understood. Ina review of grouping research, Findley and 
Bryan (1971) concluded that "taking all studies (of ability grouping) into 
account, the batanee of findings is chiefly of no strong effect either favorable 
or unfavorable'' (p. 54). 

There are numerous problems with the grouping research. The range of 
abilities in one study may be different from that used’ in another one. Fur- 
denser hi tacany two studies may both examine grouping they often use 
very different instructional methods. Clearly, given such differences it Is 


impossible for this research to cumulate and lead to powerful generalizations. si 


10 


What we need is a precise taxonomic scheme which allows a thorough description 
of the instructional method so that investigators can be reasonably sure of 
: having two graups working on. instructional methods which are highly similar = , 


2xCePs t for the variable being EM anse A Seeks point for such a 
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schuie may be- the useful classification of content aid: nethod sRepdsad by the 
San Diego Navy Personnel Research and Development Center Group (Note 9, | 0), or 


u 


the work of Merrill (Note 11) and Relgeluth hore 12). 


knothar problem for ATI researchers 1s In the classification of student 
aptitudes. Let’ s use ‘the area of anxiety as an example. Most tests of aniiety 
tend to eortelate with one another at approximately .45, meaning that 80% of 
the variation of scores in one of these tests is unactounted for by variation in 
the other. Hence, different anxiety ATI studies, an area in which research 
is plentiful (Cronbach aid Snow, 1977, Chapter 10; Tobias, 1977a, 1979), can 
hardly be considered to have studied the same problem if different indexes 
of anxiety were utilized. these problems are’ obviously multiptted if the 
instructional methods or other aspects of the study nied also been changed. ~ 

These sxamp 14s of chaos [In ATI land suggest that better description of \ 
both | the instructional method and individual difference: parameters is required. 
In addition, it is ‘important far ATI research to ke driven by a consistent . 
instructional theory, rather than speculations generalized from research in 
other fields. i‘ 

Much early ATI research in anxiety was borrowed from Spence-Taylor's 
drive theory (Spence & Spence, 1960), which predicted that individuals high 
in anxiety could be expected to do better than their ieccannieda counterparts 


on easy material, and the opposite state of affairs woutd exist on difficult 


matertat. ATl-researchers, including this one (Tobias & Williamson, Note 13), 


Tacared Spence's (1958) warelny that this formulation held only In tightly 
circumscribed. experimental. contents consisting largely of classical Senete 
ttontng procedures, and should not be blithely a applied to more complex 
instructional settings. Reviews of this research: (Cronbach & ants 1977; 
Toblas, 1977a) have verified this caution, and what we hope are more appro- 
priate models for research on anxiety ‘and .instructional methods (Tobias, 
1977b, 1979) have been’ proposed. “ite me turn to another attempt to approach 


ATIs from a consistent Instructional paradigm rather than from loose generali- 


zations borrowed from other areas. 


Prior Reh tawessiere and Instructional Support " 

In an attempt to integrate a number of ATI studies (Tobias, 1973a) con- 
cerned with such variables as anxiety, creativity and a variety of instruc- 
tional alternatives using programmed aaeetials it was noted that none of 
the fnderuet tonal variables made any difference when material with which 
students were familiar se used: On novel content, on the other hand, it | 
was general ty Found that eliciting student responses, providing feedback 
concerning them, and tight organization of the instructional material made 
substantial differences in student achievement. These findings led to the 
statement of a general hypothesis (Tobias, 1976, Note 3) predicting an Inverse 
relationship: between prior knowledge and amount of fngerdetional aubphve 
required in order to eater educational objectives. Prior achievement is, 
of course, easily defined by a student's pretest score.’ Instructional support 
may be defined as the assivtance given to the learner in oreantztag content, 


making provisions to maintain attention, providing feedback regarding the 


student's performance and monitoring achievement at a micro level from one 
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“unit: to another. The hypothes!s implies that the lower the level of prior 


, \ - : 
achievement €he pore assistance needs to be provided to the learner in order 


‘to master ORJACEI VER: Conversely, athe: higher the level of arier achievement, 
the less such assistance Is. none by students. if . 
Sone of ‘the most recent results dealing wien this hypothes!s may 
' tl Tustrate the general approach. \an a ‘study (Deutsch & Tobias, Note 14) 
using four video modules dealing “ie ndi vidual ized fasteicklan, the ’ 
; instructional Support variable consisted of giving students the option of | 
rewinding video tapes by viewing them individually, or being unable to do so 
| when viewing. them in group form. As expected, we sbbatwad the significant 
ifGiackion shown In Figure | between having the option to rewind the tape 
and achievement. , . 
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Insert Figure | about here 
| Gite eee Ny ee ee 
Students who were able to rewind the hape outperformed those denied that option 
and, as expected by the. ach lavanent Erestment formulation, the différences Loa 
/ “anong these groups were siuatar at the lower end of the achievement | | 


‘hare the higher end. 


Thi's Is precisely the type of ordinal baceraceton expected from the prior 
ac levement-instruct ional support hypothesis; other ‘evidence supporting this 
forma ation is sietariass siswenere (Tobias, 1976, Note 3). In order to 

show you that all Is not rosy In aid duisen esacea tanta inecoberten deat elther, 
there Is ates some egeant evidence failing to support dorecnvaetiwils (Tobias 

& Redfield, Note 15). a : 

| The achievenent-instruct tonal support hypothesis avoids same of the 
problems seleeavinarether ATI research. Specifically, since a pretest 


( 


is necessarily ‘specific to the content taught, its similarities and differ- ° 
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ences to other measures pose less of a problem. That Is, a pretest Is not 


’ assumed to have any generality bevond darving aS an Index of the degree to 
‘julie particular content has béen mastered. It may well be chat pretest 
scores contain components other than rouledan of a specific subject matter, 
such as test-taking skills, intalitgenee, and the like. While such more 
* general abilities may contribute to pretest scores, dhaxpresent Hypaehests 
Is that it ts the unique variance attributable to a particular content ae 
will be most useful in predicting optimal Instructional method. 
A number of studies dealing with Seg formation (Alvord, Note 16), 
Ny intelligence test data (Tobias, Note 3); and instructional material (Tennyson 
x & Rothen, 1977) used both data from the more’ general, traditional individual 


* 


\ difference measures and data highly specific to the task to predict the 


\ results of prior trials. It was shown that the latter data were most useful 


in predicting the results of future trials. Thus, while specific pretest 
scores may well be correlated with more general aptitude feastires: | would 
predict that the pretest is nonetheless ox useful In adaptive instructional 
decisions. 

The hypothesized interaction betweeri prior achievement and: instructional 
support is somewhat similar to one of the conclusions reached by seereeh 
& Snow (1977) following their review of ATI research. They suggest that any 
siatedlkes which reduce the intellectual demands made on the student by the 
instruct tonal method would reduce achievement differences between students of 


high and low intelligence. The concept of instructional support Is, obviously, 


not dissimilar to procedures reducing the Intellectual demands of a task. 
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' Psychological Processess and ATI Research 

There are other S oneusches to bringing order to the discrepant research 
findings In this area. The desirability of. Saiwetce achiévenstit from different 
instructional methods to Individual differences im the psychological processes . 
underlying aptitudes has been advocated ay a eee of writers (Glaser, 1971, 
1976; DiVesta 1972) and stimulated a sedidleat of contemporary research. 

Some of the difficulties in ne approach have been alluded to elsewhere 
(Tobias, Note 3). In sumary, it has been suggested that such research offers 
the etetsino prospect of ve a tet to speci fy the psychological processes 
on which aitraragnas in cognitive processes such as intelligence, problem . 
solving ability and the Mine are based. Such research may clarify some 
traditional sroktans of educational peysnoregy such as ‘the naturecnurture 
controversy and the structyre of human abilities. In addition “such research 
opens ap the possibility of investigating the degree to which instruction in 
the psychological processes can modify students!’ standing on such cognitive 
‘aptitude variables as feel Tgenen, anptalnly Gh aac eles possibility of | 
enormous practical and theoretical consequence. Recent research in this area 
is summarized in an issue of the Journal Intelligence (Note 17). 

It has been suggested (Tobias, Note 3) that adapting instruction to 
differences in psychological processes mey not be as promising a*line of 
research as-it appears. The principal problem of such research would appear. 
to be the high probability that processes underlying instruction in any 
moderately complex topic are likely to shift very rapidly. An instructional 

| strategy, then, which Is designed to capitalize on processes at the outset 


of some content may be less then functional once the student has made some 


* a 
progress into the course. 


“Observation and ATM Research 
SS ee 


Adapting Instruction to differenc s tn psychological processes 


may be useful In two areas: 1) Actually\ teaching the psychological 

processes (a: indicated above), and 2) In tructing students In content 
appropriate for the first few months of farmal school Ing, such as 

decoding In raadlig and acquiring some of t . basic quantitative ‘. are 
concepts. Such ecient are, of course, extremely important. It 

should be noted, aie? that such ee ts likely to be axtrene}y 
brief, probabl| last ng no more ean envgeal deka: While this ts an 


Important nina It Is nonetheless of IImited importance when one 


) considers the 12! years of compulsory schooling at the elementary and 


saxondars levels not to speak of Instruction at the college under- — -/ 


graduate and graduate levels, and learning in a variety of training 
. : j . . 
contexts. 
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Research relating teacher behavior to student achievement: may well have 
an important lesson for ATI researchers. The essential method we in that 
research (Brophy, 1979) was to conduct careful observations of classroom wy 
behavior free from high inference schemes, or heavy theoretical.preoccupa- 
clones Conceivably, ATI researchers could adopt that method. Instead of . 
beginning r search by generating a prediction as to what students are likely 
to do ie an instructional sifuation where a waciens of alternatives are 
available, it might well be better first to watch wpa students of varying 
individuat difference characteristics actually sip and what Instructional 
options they select. One wonders whether all of the research relating mode 


” 
of responding. to instructional materials to anxiety (Tobias, 1973a, 1977a) 


‘ 


might not have most profitably begun by matching students of known anxiety 
. . » 


’ characteristics select ‘available options, and ask students. to provide rea- 
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sons for their selection, rather than begin by hypothesizing outcomes in an 
area in which few instructional ly relevant prior studies had been conducted. 
Conceivably a lot of findings of non«significant differences could have been 
avoided this: way: in the-pint. ea hopefully in sha Fubiiia 

ATI researdhice U-atl areas, not Sato those working in the vineyards 
of response modes, might well learn this lesson from our colleagues who have 


been observing teachers for some Sane and save ourselves expensive research 


- 


rag heng in ene snnt leant differences. 
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This selective and somewhat blased review et the problems jn ATI research 
must conclude with a note near and dear to the hearts of educational researchers: 
further research is obviously needed. One of i early Dia ll in “this 
Hale was the publication of the book edited a eaane in 1967, or tiireann F 
years ago. In the faith. in which | was reared; 13 marks the advent of adult- 


hood and ee ee for one' s actions. | ‘am not sure that ATI-research 

has achieve siyehosa: nor am | all together sure that adulthood is such a ; 
desirable state. | have tried to suggest that. in these 13 years, | think 
we have not discovered any blinding revelations which have answered the most 
vexing questions in this complicated field. | do feel, however, that our 
questions are clearer and more precise. In the years to come, | would imagine 
that our answers to these questions will be equally specific’and precise. 


Enlightenment in this area, then, will be similar to that in most other fields 


of scientific Inquiry. That is, we will learn more and more about less and 


less. 2 
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Footnotes 
. Fad 
; ; * 
I. This. paper was presented at a symposium entitled ''Psychology and 
Education--State of the Union,"' held at the annual convention of 
the American Educational Research Association, ‘Boston, April 1980. . 
It*is based, In part, on a chapter entitled, "Adaptation to 


Individual Differences," in F.H. Farley and N.J. Gordon (Eds.), 


/ New erspectives In educational psycholo National Soctety for 


i /> the Study of Education. In press. ‘ 
/ * | = = 
"2. Preparation of this paper*was partially supported by the Institute 
for Research and Development: in Occupational Education, Center for 
: ‘Advanced Study in Education, City University of New York. 
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